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Abstract 

Novel constructions of empirical controllability and observability grami- 
ans for nonlinear systems for subsequent use in a balanced truncation style 
of model reduction are proposed. The new gramians are based on a gen- 
eralisation of the fundamental solution for a Linear Time- Varying system. 
Relationships between the given gramians for nonlinear systems and the 
standard gramians for both Linear Time-Invariant and Linear Time- Varying 
systems are established as well as relationships to prior constructions pro- 
posed for empirical gramians. Application of the new gramians is illustrated 
through a sample test-system. 

AMS subject classification numbers; 93B05, 93B07, 93B15, 93B40 
Key Words: controllability and observability gramians, model reduc- 
tion, balanced truncation, Lyapunov equation 

1 Introduction 

The development of effective model reduction techniques is of paramount im- 
portance for all areas of engineering. These include control system design for 
nonlinear mechanical, chemical and electronic engineering systems, the design of 
Radio- Frequency (RF) integrated circuits and many others ^ - |18| . 

In linear system theory (e.g. see [201 and the references therein), the 
input-output interaction of a system is characterized by the so-called gramian 
matrices or gramians, which can be subsequently used in a model reduction pro- 
cedure, called balanced truncation ^5] - For general nonlinear systems the 
notion of gramians and balancing has been derived from the more general concept 
of controllability and observability (or energy) functions [53] - However, the 
calculation of the energy functions is computationally expensive and the result 



is rarely an explicit solution [23] - For these reasons, it is very difficult 
to apply this method to large-scale problems p. Several recent research papers, 
followed by [S] - [5], have presented a specific framework for the analysis and 
model reduction of nonlinear models for the purpose of control termed empirical 
balanced realization. In the present paper, some shortcomings of this approach 
as regards the determination of the empirical gramians are detailed in Sections 3 
and 4 and an improved approach for the computation of the empirical gramians 
is suggested in Section 5, Definitions 3,4- Numerical tests are given in Section 6. 



2 Empirical gramians and balanced truncation 

As in Lall et al. the non- linear system under consideration is of the form: 

x{t) = f{{x{t),u{t)) (1) 
y{t) = h{x{t)) 

where / : x — > R" and /i : R" ^ R' are nonlinear functions, the function 
u{t) G R'' is regarded as an input signal to the system and the function y{t) G R' 
is an output signal. A simple idea, used extensively in the analysis of autonomous 
nonlinear systems, is to compute a trajectory x{t) on the time interval [ti, tf\ and 
to consider the integral |17| x{t)x{t)'^ dr as an approximation of the exact 
gramians for subsequent construction of an appropriate projector (the superscript 
T denotes transposition). The method proposed in X for general nonautonomous 
systems stems from this basic idea. Data, taken either from experiments or from 
numerical simulation and consisting of sampled measurements of x{t) and y{t) , 
is used to parametrize the trajectories for the nonlinear system. 

The following constructions for empirical controllability and observability grami- 
ans are then proposed in 

Let M = {ci, C2, . . . , Cs} be a set of s positive constants, T" = {Ti, T2, . . . , Tr} 
- be a set of r orthogonal n x n matrices and E" = {ei, 62, . . . , e„} be the set of 
standard unit vectors in R" . 

Definition 1. Let T^, and M be given sets as described above. For the 
system the empirical controllability gramian is defined as: 

r s p 00 
1=1 m=l 1=1 "'0 

where e R"^" is given by = (a;*''"(<) - x*''")(a;*''"(t) - x*'")^ 

and a;*''"(i) is the state of system ^ corresponding to the impulsive input u{t) = 
CmTieiS{t). Here 5{t) denotes Dirac's delta function. The mean w of a function 
G Li is given as: 

1 /■* 

w = lim - / w{T)dT. (3) 

t^oo t Jo 
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Definition 2. Let T", E" and M be given sets as described above. For the 
system the empirical observabiUty gramian is defined as: 

Q = J2Y.z-r m'-mrdt (4) 

1=1 m=l -^0 

where e R"^" is given by ^-^^(0 = (2/'''"(t) - f^'^Y{y^^'^{t) - j/J'") 

and is the output of system |^ corresponding to the initial condition 

2.iim(o) = CmTiCi with input u = 0. 

The purpose of using the sets M, T" and E" in Definitions 1 and 2 is an 
attempt to ensure that the entire region of feasible values of initial inputs/states 
is covered and probed. The set E" defines the standard directions and the set T" 
defines 'rotations' of these directions. The set M introduces different scales for 
each direction of the initial states/inputs. 

In what follows several shortcomings associated with Definitions 1 and 2 are 
brought to light and novel proposals for improvement are suggested. 



3 Linear time-varying systems 

An examination of Linear Time- Varying Systems (LTVS) in the context of model 
reduction is both nontrivial and instructive. The controllability gramian pro- 
posed in Definition 1 for a non-autonomous system x = f{x,t) does not yield 
the standard controllability gramian for such systems ^Tj. Furthermore, the 
derivation of the standard gramian for LTVS provides a motivation for the new 
improved constructions suitable for nonlinear systems. In what follows, for sim- 
plicity, only one-dimensional inputs and outputs are considered, i.e. p = q = 1 in 
(HJ, 0. Consider a LTVS: 

x{t) = A{t)x{t) + B{t)u{t) (5) 
yit) ^ C{t)x{t) 

The fundamental solution of Q is defined as the solution of: 

Q{t) ^ A{t)Q{t), e(0) = / (6) 

where I is the corresponding identity matrix. For example, if A is a constant 
matrix, (as for the linear time invariant system ~ LTIS) then one simply recovers 
the very well known solution Q{t) = exp(Ai). The general solution of © is: 

x(t) = Q{t) (^e-i(to)x(to) + ^ Q-\T)B{T)u{T)dT^ (7) 
Now let to — oo, ^ and x{—oo) = 0. From Q it follows: 

/O roo 
e-\T)B{T)u{T)dT = / e-\-T)B{-T)u{-T)dT (8) 
-oo Jo 
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and as usual, one can define a Controllability operator: 

C:i2([0,oo))^M" as / dTe-^{-T)B{-T)» (9) 

Jo 

and Controllability gramian as: 

/•oo 

P= Q-\-T)B{-T)B^{-T)Q-^^{~T)dT (10) 

^0 

From with io = and w ee it follows y{t) = C{t)O{t)x{0) and therefore the 
Observability operator can be defined as: 

O : M" ^ L2([0,oo)) as O = C(i)e(t) (11) 

and the Observability gramian is: 

/•oo 

Q= e^{T)C^{T)C{T)e{T)dT (12) 

Jo 

Strictly speaking, the gramians for LTVS must depend on t as shown in |2], 
|17|. However, for the purposes of model reduction, constant gramians are pre- 
ferred and the constant versions H10|l and l|12() are used as approximations. The 
expressions in H1(J|) and (|12|l are generalisations of the gramians for LTIS where 
&(t) = exp(At) pp. 



4 Bilinear representation of nonlinear systems 

Another very interesting class of nonlinear systems that it is instructive to examine 
are the bilinear systems; moreover a wide class of nonlinear systems (subject to 
suitable restrictions- [5], |El)j ni^Y be represented in a bilinear form. The 
bilinear system is also interesting because there is an exact solution when the 
input is a delta- function and thus the gramians Q and can be tested explicitly. 
Consider the following bilinear system: 

i{t) = A{t)x{t) + Nx{t)u{t) + Bu{t) (13) 
y{t) - Cx{t) 

Again, it is assumed that all the eigenvalues of A have negative real parts. Let 
the sets employed in Definition 1 be as follows: M = {ci,C2, . . . ,Cs}, T = {1} 
and E = {1} since p = q = 1. Thus the inputs to the system are of the form 
uo{t) — CmS{t) . The solution to (|13(l with an input uo(^) — Cm5{t) is: 

x"'"(i) = e^* (^I + + + . . Bc„,e{t) (14) 

where 9{t) is the unit step function. Note that the sum in H14|l is finite since N 
is nilpotent by construction [2], ^Hl- {x^^^{t) corresponds to Sf^™{t) with i = 1, 
/ = 1). Following from Definition the Controllability gramian is therefore: 

Pbl = / e^^B^Bj^e^^^dT (15) 
Jo 
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where 




(16) 

Since the bihnear system assumes a hnear form when the input is zero, the 
Observabihty gramian is as usual: 

Qbl - / ^C^Ce^^dT (17) 

Jo 

It is not difhcuh to prove that the gramians in H15() and (|17() are solutions to the 
following Lyapunov Equations: 

APbl + PblA^ + BnBI = (18) 
A^Qbl + QblA + C'^C = 

However, there are the following problems with the gramians in H15|) and H17|l . 
Firstly, they do not relate to the known gramians for the bilinear systems 14^ - 
[T^ . [TH| . Secondly, itTH) suggests that the Krylov space for the ControUabihty 
operator is span{A^'i7VP^_B} for pi > 0. However, the known Krylov space ^| is 
sp&n{B;AP^B;AP^NAP^I3;...;AP^NAP-^N ...Ap>'B} for p, > 0. 



5 Nonlinear systems 

The nonlinear system in |^ has a rather general form. In [2], it is suggested 
that the use of the empirical gramians ^ and Q is limited only to control-afFine 
systems. Indeed, for example, for a system, depending quadratically on the input, 
the square of the Delta-function cannot be defined. 

For the present analysis, let the nonlinear systems be of the form: 

i{t) = f{t,x{t))+B{t)u{t) (19) 
y{t) - h{t,x{t)) 

It contains two terms: a dynamical term (or drift term) f{t,x{t)) and a source 
term (or diffusion term) B{t)u{t) . Clearly, LTVS systems are of the form in H19(l . 

Instead of considering different inputs and 'mean values' as in Definitions 1 
and ^, it is more natural to analyse the system in a vicinity of an equilibrium point 
when u(i) = . Consider the vicinity of an isolated asymptotically stable equi- 
librium point (steady-state solution) which is supposed to be a constant solution 
and is chosen for simplicity at a; = 0, i.e. /(i, 0) = 0. It is also assumed that the 
system does not leave the region of attraction of this equilibrium point when the 
input is applied for the initial data used. If the system exhibits multiple steady- 
state solutions, then the analysis may be applied separately in the vicinity of each 
solution provided that extra care is taken to ensure that the system does not leave 
the region of attraction of the corresponding (asymptotically stable) equilibrium 
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point. Of course, the constructed gramians will therefore only provide a basis for 
reduction locally in the vicinity of the selected equilibrium point. 

In this work, it is proposed to make use of an approximation for the most natu- 
ral object - the fundamental solution Q of (|19|l that would generalize the ex.p{At) 
term for linear systems. This is reasonable since the projection Krylov spaces 
for linear systems are generated by their fundamental solution e'xjp{At). The con- 
structions would, in general, depend on O for negative times which is unavoidable. 
For linear systems, of course, there is a simplification since (c^*^"*^) = e"^* so 
this docs not present a limitation but in general, Q~^{—t) ^ Q{t) , cf. (jlUfl . 

Let a;''™(i) be the solution of ^ with u = 0: 

x{t)^ f{t,x{t)) (20) 

and with initial condition: 

x'""(0) = c™r,ei (21) 

It is assumed that the initial condition (|21|l does not take the system outside the 
region of attraction of the equilibrium point a; = 0. Then the 'state-space average' 
of the 'nonlinear' fundamental solution may be defined as: 

(QW) = ;^EEE;^-*"W^"^" (22) 

m=l i = l 4=1 

where the sets M, T", E" previously defined for Definitions 1 and 2 are employed. 
Indeed, for a LTVS, x''™(i) = e(t)c™r,e, and therefore (e(t)) = e(i). 

The following constructions of empirical controllability and observability grami- 
ans for the nonlinear system H19(l are now suggested: 

Definition 3. For the system in (|19|l . the nonlinear controllability gramian is 
defined as: 

{e{-r))-'B{-r)B^{-rm~T))-'^dr (23) 

Jo 

where (0(t)) is as described in (|22|l . 

Of course, this construction requires that (0(— t)) is invertible for all r > 0. 
H23(l is obviously a generalisation of H10() . 

Definition 4- For the system in p9(l the nonlinear observability gramian is 
defined as: 

Q - / z^(r)z(r)dT (24) 
Jo 

where z(t) £ R" is given by: 

rs ^ Cm 

and y^'-™-{t) is the output which corresponds to an initial state x*'™(0) = CmTiCi 
and a zero source term. The motivation for this construction is as follows: 
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For a linear output y{t) = C{t)x{t), since = 6(i) the observability 

gramian (|12|l is: 

/•oo 

Q= / {e{T))^C^{r)C{r){Q{r))dr (25) 
Jo 

Since 

C(r)(e(r)) = 1 ^ ±C{t)x^^^{t)eM = ;^ E ;^/'"Wefr,^ = ^(t) 

then the construction in H24|l is confirmed as a generalisation of p2|l . 

Both gramians if^ and (|^ when applied to LTVS (or LTIS) thus result in 
the usual gramians i.e. H1Q|I and H12|l . This confirms the motivation for their use 
in preference to (O and Q). 



6 Illustrative numerical example 

The circuit employed is the nonlinear RC ladder shown in Fig. 1 (frequently 
employed as a test circuit for model reduction techniques jJU] - CHI)- The 
example enables comparisons to be made between the existing formulations for 
empirical gramians and those proposed in this contribution. The nonlinear re- 
sistors (a diode in parallel with a unit resistor) have the constitutive relation 
i{v) = (e^"" — 1) + V (where i represents current and v represents voltage). The 
capacitors have unit capacitance. The input is a current source u(t) = e~* enter- 
ing node 1 and the output is the voltage taken at node 1, Fig 2(a). This is an 
example of a gradient system (e.g. according to the definition in |27|). since the 
equations describing the system may be written in the form: 

V = -VV + Bu{t) (26) 

y = Cv = vi(t) 

where B ^ [I ... 0]^, C ^ B'^ and 

Viv) = le-- -1 + I + E (^e-(---.^) - (.. - ..,r) + ^-^^tZl^) . 

fc=i ^ ^ 

(27) 

The function V{v) represents a strong Lyapunov function for the gradient sys- 
tem as described in |27| . This then enables the application of Lyapunov stability 
criterion to show that = is an asymptotically stable equilibrium point of the 
system (when the source is set to zero). 

The number of nodes in the system is n = 30. The time interval chosen for 
consideration is i £ [0, 1]. The reduction of the original system to a system of 
order 3 is implemented using several different methods. 

In order to compare the new gramians with the existing constructions for 
empirical gramians {Definitions 1,2), a bihnear representation dj of the 

system in (I2fill - H27|l is employed. The reason for doing this is that an exact 
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solution exists for a bilinear system when subjected to impulsive inputs. This is 
of importance in the formation of the gramian as specified in Definition 1 as it 
necessitates subjecting the system to impulsive inputs. A bilinear approximation 
with two terms in the Taylor's series expansion is employed. The resultant bilinear 
model is of order 30 + 30^ = 930. For information, the Root Mean Square (RMS) 
error between the result from the nonlinear model H2t)|) and the full order- 930 
bilinear approximation (|13() is 1.0 x 10~^, Fig 2(b). 

As a benchmark, consider the simplest reduced model (of order 3)- that which 
employs only the linear part of the bilinear approximation to form the gramians 
necessary for balancing. To be specific, the gramians employed are the solutions 
of the following Lyapunov equations: 

APbl + PblA^ + BB^ = 0, A^Qbl + QblA + C^C = 0. (28) 

The RMS error in comparison to the full order- 930 bilinear model is 2.6 x 10^^, 
Fig 2(c). 

Now consider the use of the gramians H18|l formed on the basis of Definitions 
1 and 2 with dim(£) = 930, M = {-5, -0.5, -1, -0.1, 0.1, 0.5, 1, 5}, T^^° = {/}. 
The RMS error in comparison to the full order- 930 bilinear model is 7.5 x 10"^, 
Fig 2(d). Moreover, it is observed that when M = {ci}, i.e. consisting of only one 
constant, the reduction process is ill-defined for some values of Ci, e.g. ci — 0.20; 
0.22; i.e. the reduced model is unstable. 

Finally, consider the case where the gramians formed on the basis of Definitions 
3 and ^ are employed for reduction purposes. The integration over r in these 
constructions is replaced by a discrete summation. The resulting RMS error (in 
comparison to the original model) is 5.3 x 10~^, Fig 2(e). This indicates the 
superiority of the novel constructions for the purposes of model reduction via a 
balancing technique. 

7 Conclusions 

The paper has proposed new constructions for empirical gramians for subsequent 
use in a method of model reduction based on 'balancing'. The important new 
concept involved in the formation of the novel empirical gramians, (|23|) and H24|) . 
is that of a 'state-space average' of the 'nonlinear' fundamental solution H22|) . 

The method is successful if the state-space average of the nonlinear funda- 
mental solution is well defined. Of course, this is not the case for all nonlinear 
systems as the solution of H20|l may not exist or may only exist for specific choices 
of the initial data. However, the method is applicable for systems for which the 
nonlinearities are not too severe, e.g. for the so-called 'weakly' nonlinear sys- 
tems as described in ^U]. For such systems, it is expected that the 'nonlinear' 
fundamental solution is 'close' to the exponential form that corresponds to the 
fundamental solution for a linear system. The new empirical gramians coincide 
with the usual gramians for both LTVS and LTIS. 
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Figure 1: Nonlinear circuit 
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Figure 2: Comparison between output from nonlinear model and reduced-order 
models: (a) Solid line - Nonlinear model (|26|l : (b) Dash-dotted line - Bilinear 
approximation (|13|l : (c) Points - Reduced bilinear system with gramians based 
only on linear part of bilinear approximation (|28|) : (d) Dashed line - Reduced- 
model with gramians H18() based on Definitions 1,2. (e) Dotted line - reduced- 
order model where the reduction is based on the novel Empirical gramians - (|23|l 
and 
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